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Abstract- In a contemporary world, people become dependent on electronic devices. Tcchj8t3jH?s help to clarification 
and structure life in many ways to meet the need of the children oriented requirements. XMk^hjMrren suffering from 
disabilities (e.g. autism) has desperate needs for elucidation and structures their life. MunjflpHs a research based system 
facilitates to support and manage their living. This paper works on MumlES syst^nuk^v^Iuate usability of the system in 
extraordinary environment for extraordinary people. The paper shows from th#swfcewobservation users need 
supporting tools to access the children's potential and challenges and to give traw^npport to overcome disabilities. 
Usability evaluation has been considered one of the key challenges to MumIH(^|slfem. The paper represents analysis, 
design of usability studies for the extraordinary user in environment. ^^^T 

♦ 

I. INTRODUC 




In contemporary world, people become dependent on-^TCN^pnic devices. According to the article published by 
The Guardian (Yeomans, 2013), children spend more^Ae in PC, TV and mobile devices. Technologies help to 
clarification and structure life in many ways [1] ta«meet the need of the children oriented requirements. The children 
suffering from autism have a desperate neejfHb^lucidation and structure their life [2]. Bhuiyan et. al. [3] have 
introduced MumlES (Multimodal Inte*fa^Vi*ed Education and Support) system which is designed for the children 
with special needs. The initial ptetotyf^ nas been developed on the Android platform and can be used on a 
Smartphone or other platforms for\jejkhildren with special needs. 

In this paper, usability t^jOTjias been taken into account for evaluation of MumlES system. Usability testing 
refers to an evaluation r^^p!Ho measure the target audience usability criteria [4] . A product or service to be usable 
it should have «>r^\asic criteria. These are usefulness, efficiency, effectiveness, learnability, satisfaction, 
accessibility, ^e^uihess concerns the degree to achieve user goals about a design, product or service. Efficiency 
measures tHtoAers goal how much accurately it accomplished and complete within the time limit. Effectiveness 
refer^^^ product behaves in the way that users expect. Learnability measure the user's ability to learn the system. 
Satisfaction refers to the user's opinion about the product. Accessibility measure what makes products usable by 
people who have disability. 

Usability testing is the portion of a large effort to improve the profitability, design decisions and minimize the 

frustration and errors for users [4]. To achieve the testing goal, system need to form a proper design, by gathering 

data to identify and measure the disability of existing product and accommodate supporting material before the 

product become release. Another goal is to eliminate frustration and design related problem of user' s point of view. 

So that, user may find useful, effective, efficient and satisfactory product. For usability testing basic elements are 
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development of research questions, use a sample for the users, represent the real life work environment, observe the 
point of end users, and collect the qualitative and quantitative measure for performance and preference basis. 

In a software development life cycle usability testing required in every phase on the basis of researchers 
questionnaires, the state of the product completeness, and the time required for the solution of the problem which 
has been found during testing. For this, four types of test are used for product usability testing for research or 
software development work [4]. These are: exploratory (or formative), assessment (or summative), validation (or 
verification), and comparison test. A product or service design and define is the basic concern of the ex^hjtitoty 
testing study. Its objective is to examine and analyze the effectiveness of initial design perception. Ip»thi^mage 
critical design issues has been considered during the interaction between the user and test mod^f^3j*^Yhereas 



measurement. In validation test study, it's assure that the problem which discovered in earl^^^has been removed 
or recovered and possibility of finding errors is less than earlier testing stage. And th^p^lest is comparison test 
which is conjunction with every three testing stage. 

Evaluation studies are generally methodology based; can be conducted foVjS^^^ standard guidelines for ordinary 
users and environment. A test plan is a standard guideline which serves print to evaluate product and user 

of the system [4]. A test plan consists of purpose, goals and objectiM«s\k/ne test; research questions; participant 
characteristics; method; task list; test environment, equipment andJogStfcs; test moderator role; data to be collected 
and evaluation measures: report contents and presentation. Jitj^misons for performing the test have focused on 
purpose, goal and objectives of the test section. Reseaw^^Jwestions required to describe the issues and queries 
through questionnaire to resolve the research. It is^jg^mportant to determine the target user of the product by 
analyzing participant characteristics during testin£>Method section describes the synopsis of the test plan. The task 
list section is consists of tasks which perforaJSt vreer during testing. To perform the task specific environment and 
necessary equipment are required foi#user\3<ne test moderate duties and responsibilities need to describe in the 
moderator role section. The perforVanceVnd preferences data should be collected on the base of research question 
in the data collection section, la^ta^port content section, it lists the points that will appear in the test report. And 
finally in the presentation ^vmf consists of communication results of the development team both prior to and 
following the report. ^A*. 

To analysis tHe Ksajirity studies of the MumlES system in perspective of Bangladesh. Some school and 
organizations a^^^ted for research and investigation to conduct usability evaluation in extraordinary environment 
for extraordlfc**' users. 



II. Related Work 

w^ipport a wider range of people including the elder and disabled people, researchers are working actively in 
this area for multimodal interface [5] and learning [6] system through mobile technologies. These technologies 
attract children to educate themselves and other function like playing game, watching TV, making contacts, gather 
information etc not only this also have internet connection. On this basis, games [7] are considered for the 
implication of developmental and learning disabilities, special cognitive and educational needs. It [8] has been found 
that children who are engaged at home with various type of multimodal texts by using different media and gather 
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Figure 1. The interface of the MumlES system. 

skills. Multimodal text refers to the path of communication works across multiple ways.^lfe mjrltiple modes or 
ways includes language of speaking and writing, movable image or static image, audio_wl(y, gesture, non-paper 
based texts etc. MumlES system is about the modes of communications in visual, tej(*^ajj*HO, and electronic [3]. A 
research [9] has been focused on to enhance social skills of the children with soeciafcreeds. Another research [10] 
has shown mobile video modeling system for the special needed children, fin^^^nrce mobile based application [2] 
has been taken into account to efficiently and accurately capture nec^ssi^ information and behaviors. Here a 
behavior stands for self-attack or injury, emotionally burst which^^ negatively impact in the human social 
structure of life. 




III. BACKGRfflflM^lTUDIES 

Mobile technologies bring opportunities in learningfcfflJ developing multimodal interface for needed people. A 

paper [1] uses this enthusiasm, for the children imlh ADHD (Attention deficit hyperactivity disorder), who needs 

special care for clarity of learning and to struJfar»their life. An ethnographic study used to identify their learning 

activities. In research methodology, 'emic' perspective has been taken into account for analysis 

requirement in order to generate^in a^puh understanding of needed children's learning requirements and its 

educational impacts. Bhuiyan etfcW this paper, have introduced MumlES (developed in mobile technology) 

system for children with sracn^ieed. A heuristic evaluation technique has been used to assess the system. For 

implementation of MuraJS^ystem, many schools has been visited to gather data and to prepare a specification for 

the system. In UK, ^^p9rt of research several cases have been studied to achieve better understanding of how the 

technologies imfJ!l^khe children. The proposed MumlES system aims is to provide self assessment and overcome 

the barrier ate\improve personal excellence, self confident and structure their life. This system takes instructions 

from tcj^^motion and speech, and also provides feedback with text, sound, light and vibration. The proposed 

s^Ktemjaimed to use Artificial Intelligence (AI) in two areas; first one is ubiquitous and multimodal activity 

monitoring agent. In this area intelligent interfaces act as agent tracker and keep records the activities of user. 

Markov decision process algorithm is used to develop the proposed intelligent scheme. The second one is to 

categorize multimedia libraries. For this area development user's profile based search and data mining algorithms 

are used. User's profile based search is made on the base of activities needs of a child and using libraries data, 

system suggested appropriate education and support materials. These two areas are developed in MumlES system. 

This system required categories are designed based on individual needs, goals and challenges. In Fig. 1 the system 
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TABLE I 

The Characteristics of Participants 



Characteristics 


Desired Number of Participants 


Participant type 




regular 


12 


backup 


4 


Total number of participants 


16 


Frequency of use per day 




infrequently: 1-5 times 


4 


moderately often: 5-12 times 


4 


very often: 13 or more times 


4 


Types of user 




Parents 


2 


Teacher/career 


8 


Counselor 


4 


Doctor 


2 


Age 




21-30 


2-3 


31^40 


4-5 


41-65 


4-5 


Gender 




female 




male 





interface has been shown. Every general category has some necessary si^^l^gories to have heuristic evaluation. 
The system develops history using graph, records activities and pmajg^fes. The researcher aim is to include 
interactive tools for the children, which can be developed based on thelCreeds and activities identified by the agent. 

MumlES system has been managed using open source ajSSipn code.google.com to collaborate with other 
researchers worldwide. Code.Google is a platform ir^^ph researcher and user are able to make direct 
communication, exchange their thought and use code^^^iplement on their own devices. In this platform MumlES 
has been introduced in Dec, 2013. A good numba^&f researchers (MumlES: Multi-modal Interface based Education 
and Support for Children with special needsHu-^kivolved in this project. Researchers from different parts of the 
world are contributing their findings a«d^fr^^edge in the domain of the research as the authors have been working 
in one specific area. ^ 




6 



IV. Research Methodology 
In this research work, utfafc^ry' testing has been taken into account to evaluate the Smart phone based MumlES 
system. Usability testin|^$eria such as usefulness, efficiency, effectiveness, learnability, satisfaction, accessibility 
has been conside^d^^proper assessment of the system. The exploratory usability studies have been designed to 
gather assessff^tVata about the effectiveness of MumlES system. Usability testing plan has been taken into 
account tt^^l*r data to create baseline usability measurement on the basis of user perspective. The participants of 
tli^dkw|j^9S system are a forum of users, parents of children with special needs, care-worker, researchers and 
te^he«, therapist (TABLE 1). These participants perform the main task help to accommodate data/ information to 
development efficient MumlES system. Questionnaires and case study has been used for data collection and to 
estimate the existing MumlES service. Therefore, both empirical methodologies, i.e. data about error and success 
rates has been measured as well as qualitative and quantitative data about participant's experience using MumlES 
system and other existing systems also have been considered for the research. 
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Few cases have been studied after observation of the participants. Some schools, resource teachers and a forum 
are established [12] for the children with special needs. They have been still trying to build an inclusive education 
system. By using MumlES, the children who need special attention within inclusive education system able to take 
special care and treatment. According to the case study [13], it has been found that, children who have disability had 
taken a special treatment for a period of time and then again he or she can keep up with her/his classmates. Some 
researchers [14, 15, 16, 17] has already proposed policies and planning to improve the quality of education and 
support system, but could not get the efficient technology based output from them. MumlES can bridge thelLij^n 
the domain. However, the intention of this paper is to introduce a MumlES system which would oualu^ro the 
usability of mobile based support system for the children with special needs in extraordinary ^^^<*lment for 
extraordinary people. 



V. Usability Evaluation in MumIES system in Banglades 
This paper proposed to evaluate usability studies of MumlES system in extragr^S^y environment for the 
extraordinary people for the children with special need in Bangladesh. Some schoo^association and foundation 
were visited for data collection and data analysis. Some common question JjS^E^ asked to all participants. During 



this study, 12( twelve) individual 40 minutes usability study session condfra^^Through their help it has been made 
possible to collect some important data for the system evaluation. ^^^users were teachers, therapists, parents, 
principal of the special school, chairman of the foundation/ association president of an association and doctor. Most 
of the teacher' s are young and they are very much interested tCh^e a such smart tool that guide them proper way so 
that they can take care of their students efficiently and tffc^tively. They need a tool that can measure the student 
performance and at the same time give some sugges^i^ror further improvement. Most of the parents are service 
holder. They do not get enough time to take a rap£e^;are of their disable child. They also wish to have a supporting 
system which help them and give them proj|!r>piection to take a good care of their children. Principal and chairman 
of the organization or school have fhe^ulte vision as parent and teacher have, but they want more to keep track all 
the performance which has been rBCT^ured on the basis of children development and produces a statistical outcome 
so that they could evaluate. th^^OTormance of their school or organization. Doctor's also feel that they need a 
system to keep track their sfccVl patient condition and also suggest some solution through Artificial Intelligent (AI). 
This AI may help bojj/^^; are -worker and the parents to manage and handle the autistic children when sudden 
difficult situatioii\\uj>r All the users are facing different environments. Like as doctors are working in hospital 
whereas teacl^kt therapists or care-workers are working in a school or organization. Both are handling many 
childrenjfrjSrerent way. All of them need a smart tool to keep records of the children and desired to access easily 
toJBIlA^ecord(s) by simply clicking on the mobile device. It has been found that from the survey according to the 
useWaquirement MumlES system meets users' basic needs. 

To meet the goal of quantitative evaluation of the research, questionnaires had been made which are as follows: 

A. You are a 

B. In perspective of Bangladesh, how successful the MumlES system will help the children with special needs? 

C. Does the system/service meet the basic needs of disable children? 

D. How much effectively it replace the existing supporting material or technologies to the user? 
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E. How well can mobile application be used, considering mobile context, mobility and slow network 
connection? 

F. Does the system reach the users goal efficiently? 

G. Is the system/service providing an appropriate balance of ease of use and ease of learning? 

H. How well do users understand the symbols and icons? 
/. Any further suggestion? 

VI. Interview and Observation ^_ N 

The following participants were interviewed and observed on their own environment. ^ 
"X" is the Occupational Therapist, working since three years. She explains about the wayihey^vt^reatment to 
the children. First when the child admits they observe his/her behavior and make assessmea^Jjpft. After that they 
make a goal plan for that child, which is known as Individual Education Plan (IEP).On^Klre goals she discussed 
about a child who is unable to write or color a picture. First they make sensory integr^^^featment in this treatment 
it content seven (07) sensors. These are vision sense, visual sense, audito^Sfcms*, tactile sense, muscle sense, 
vestibular sense, and proprioception sense. After evaluation of each sens^^^nanage that child to finally grape a 
pencil in her hand and develop her understanding and concentration ijktl^id able to write/ color picture. As she 
came to know about MumlES, she admits that this type of . sorC«re is very helpful for both parent and 
teacher/carrier. Because parent wants to know their child cqjjSSVi and development phase which is difficult to 
explain sometimes. But if they have such software whidflh^ only contain data about the children strength and 

ojv^^nd" 



weakness but also produce some suggestion about hojv^^ndle and educate their children. 

According to the participant "Y", she is an^ademic coordinator, one of the schools of autistic children in 



any^ade 

Bangladesh. They follow some specific teactrjajgtetehniques which are as follows: teach own name (Who are you?); 

Sign follow (School, Medical, Smile,^ftVfi*|ht); Written instruction; Time consult (where it is day or night or 

evening, what time is it? etc); Moi|ey hffl|aring(like, if you have 50/- taka on your hand and you bought a pen by 

10/- taka, then calculate how manj^^fe left?); Road Crossing; Activity of Daily Life (ADL). She also said that five 

(5) sense of human is not ap^wyflate for them to sense properly. Some children do not like that somebody touch 

them and in some other^S|CTWiild do not sense even his/her hand got hearted. They do not know how to response, 

even some child tfie^dXnot rectify any taste of food. Inner Sense: proprioception and vestibular also taken care of. 

She found thatVfl&i^Bf the children are so expert on the some specific field that, if they get proper guideline, they 

can improvdhmirjob skill on that specific area. Like if someone is good in computer operator or like to play games 

iricomjj^^, in this specific area if the child gets proper direction then the child can learn how to earn from this area. 

Tius saiool is specifically working on to improve students' job skill on their expert area(s). Specific software has 

been developed for money handling system. As she came to learn about MumlES system she admit that this type of 

software can help them to handle those disable children to give proper guideline as they already do in paper-work 

and student strength and weakness can easily measure for their development. 

Participant "Z" is the General Secretary of an association. He admitted that MumlES system may help to full fill 

the basic need which is the routine work of autistic children. As they share their experience, the autistic children 

have to do some regular works. There is not special treatment that they required. They need only proper care and 
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maintain regular routine. That is why, a participant suggest to create a level basis system, like a child(x) who do not 
have a knowledge of the color s/he should have to practice it regularly to gain the idea of the color. But the child 
(y)who have already got the idea of the color knowledge s/he can color the scenery, so s/he do not need to practice 
color matching games or anything like that. So, here two children are different and one child is advance than 
another, so the care-worker who have not any idea about those children, but if s/he got a service and s/he can see the 
symptom of the children and can get direct idea that the children x, have different level of routine life and children y 
have another level of life style, this device may suggest care -worker to maintain those level through thi*^mt:eV. 
According to the participant, he suggest that slow network connection may be not required if the spetemriave 
multiple video's or suggestive document implicitly, so that sudden decision can be made froJfftth*Ke useful 
documents. As for example, if child become very angry for the food s/he is going to take, mgybe^diere is some AI 



mpYbe" 

suggestion will be appear when this type of situation arise and child may start to tak^^H after apply those 

treatment which the care-worker may get from the service. Considering mobile applicative wished that this app 

should be in hand of all parent in very soon. He also suggest to make a link up type ^^^tn, that the parent may look 

after whether the care-worker taking care of his/her child properly or not, heWgg^stto make an acknowledgement 

AW 

option so that parent may track that whether the routine work is working BKJ|||Hy or not. If not than parent can give 
some reminder to the care- worker. According to the participant, MumtfiJ^j^tem needs to modify in perspective of 
Bangladesh, because most of the parents are uneducated or know or^rnative language. So, if the apps in native 
language version then the parent will use the apps properly, ba^^lPsmart phone or mobile device is very expensive 
for some parent to buy or to maintain those devices. Becajt^Hbst of the parent are from rural area and it is difficult 
for them to buy those expensive device. 

Participant "W" is a Doctor and also a chairma#fWan autistic children school. She and her organization are trying 
to develop each child according to their sn^Jfc Serialization field. And make them self confident and improve 
their skill in the right direction. They £s^vbdf on their behavioral, social and communicational area to make them 
independent and be social. The ^JumTBS system will help to measure the student current status and further 
improvement. She also hopes dMtA^mdent her/himself may use for his/her own skill development purpose. 

iO 



VII. Discussion and Result 
The result shows the^^^rtance of the usability of study, before further design, development and implementation 
of the MumlES^taan^For the usability testing research question, user's environments, and the points of end user 
has been col]|^ltedV>n the basis of qualitative and quantitative measures for performance and preference data 
analysis._gAc%llaboration in Google's code system provides a platform to disseminate the findings of the study 
researchers worldwide. However, through interview and observation, it has been found that system able 
5rm independent learning and support platform for the users. The primary findings from the qualitative 
investigation show significance of the study. 

VII. Future Work and Conclusion 

The children with special needs required sufficient resource and technology to support them and to educate those 

children. From the interview it has been found that care-worker and parents needs tech support for keeping track 

each child for the betterment of their life. It has also be found that from observation, to reach to all level of people, 
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system need to add an option to translate the instruction into native language so that the users will use the apps 
properly. Another future plan is keep record in not only smart phone but other mobile devices as well to keep not 
only one children record but also the records of all student of a school or foundation. 
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